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The  Honorable  Jack  Brooks 
Chairman,  Committee  on  Government 
Operations 

House  of  Representatives 
Dear  Mr.  Chairman: 
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Subject:  Evaluation  of  DOD  Comments  Re:  "DOD  Instruc¬ 
tion  5000. SX,  Standard  Instruction  Set  Archi¬ 
tectures  for  Embedded  Computers" 

As  requested  by  your  office,  we  have  evaluated  the  Department 
of  Defense  (DOD)  comments  on  our  letter  report  "DOD  Instruction 
5000. 5X,  Standard  Instruction  Set  Architectures  for  Embedded 
Computers"  ( MAS AD-8 2-1 6 ,  Jan.  27,  1982). 

We  recommended  that  the  Secretary  of  Defense  not  implement 
Instruction  .5000. 5X.  We  also  recommended  that  the  Secretary  of 
Defense  direct  the  services  to  reevaluate  their  ongoing  efforts 
and  demonstrate  why  they  are  more  cost  effective  than  standardiz¬ 
ing  on  a  high-order  language  such  as  Ada  and  relying  on  the  com¬ 
puter  industry  to  provide  the  stimulus  for  computer  architectural 
innovations. 


DOD  disagrees  with  our  conclusions  and  recommendations^*  DOD 
continues  to  take  serious  issue  withieuf~'asses8ment  of  the  via¬ 
bility  of  instruction  5000. 5X.  DOD 'maintains  that  its  rationale 
for  curtailing  high  hardware  and  software  costs  is  sound.  That 
is,  by  legislating  the  architectures  for  embedded  computers,  DOD 
contends  that  hardware  and  software  costs  will  be  minimized. 

However,  we.  contend  that  DOD's  approach  of  mandating  its  own 
architectures  should  be  challenged  because  it  duplicates  commer¬ 
cially  funded  hardware  and  software  research  and  development  in¬ 
vestment.  More  importantly,  it  constrains  the  creative  potential 
of  the  electronics  industry  in  applying  modern  technology  to  solve 
military  problems.  We  are  also  concerned  that  the  duplication  will 
result  in  DOD  spending  considerable  amounts  of  research  and  devel¬ 
opment  money  for  technologically  obsolescent  computer  systems.  We 
address  each  of  DOD's  concerns  in  our  enclosed  evaluation.  In  ad¬ 
dition,  we  plan  to  provide  a  comprehensive  evaluation  of  their  key 
issues  in  our  forthcoming  report  on  this  subject. 
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As  arranged  with  your  office,  unless  you  publicly  announce 
its  contents  earlier,  we  plan  no  further  distribution  of  this 
report  until  30  days  from  the  date  of  the  report.  At  that  time 
we  will  send  copies  to  interested  parties  and  make  copies 
available  to  others  upon  request. 
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ENCLOSURE  I 


THE  SECRETARY  OF  DEFENSE 

WASHINGTON.  D  C  20101 


*  APR  1982 


Honorable  Charles  A.  Bowsher 
Comptroller  General  of  the  United  States 
Washington,  D.C.  20548 

Dear  Mr.  Boivsher: 

This  is  in  reply  to  your  recent  letter  which  provided  a  copy  of 
GAO  letter  report,  "DoD  Instruction  5000. 5X,  Standardization 
Set  Architectures  for  Embedded  Computers,"  (MASAD-82-16) ,  dated 
January  27,  1982,  (OSD  Case  fS889). 

I  must  respectfully  disagree  with  your  conclusions  that: 

o  "...this  (proposed)  policy  would  lock  DoD  into  the  use 
of  inferior  technology." 

o  "...DoD  would  not  be  able  to  take  advantage  of  private 
industry's  technical  innovations." 

o  "...it  would  severely  restrict  competition  to  those 
companies  willing  to  help  DoD  implement  obsolete 
technology.” 

Our  experience  to  date  has  demonstrated  the  opposite  effect. 
Hence,  we  believe  the  proposed  policy  is  an  established  success, 
even  before  formal  issuance. 

The  GAO  was  invited  to  observe  meetings  of  the  recent  Defense 
Science  Board  review  of  this  subject.  However,  the  two  groups 
reached  quite  different  conclusions.  Further,  the  conclusions 
and  recommendations  of  the  GAO  report  do  not  track  with  their 
earlier  reviews  of  this  same  issue  ("The  Department  of  Defense's 
Standardization  Program  for  Military  Computers* -A  More  Unified 
Effort  is  Needed, 'r  June  18,  1980,  LCD-80-69). 

One  recommendation  from  that  earlier  report,  and  echoed  in  the 
current  letter  report,  is  that  Ada  should  be  implemented  as  DoD's 
standard  programming  language.  Ve  agree.  Ve  followed  GAO's 
recommendation  to  establish  a  tri- Service  program  office  for  that 
purpose. 


ENCLOSURE  I 


ENCLOSURE  I 
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Experience  with  the  principles  of  5000. SX,  although  it  has  not 
been  formally  issued,  are: 


There  were  12  significant  bidders  for  the  Army  Military 
Computer  Family  (MCF)  Program  based  upon  the  Government 
MIL-STD-1862  Instruction  Set  Architecture  (ISA).  Earlier, 
when  the  program  was  based  upon  a  commercial  ISA,  there 
were  only  two. 

There  are  over  20  suppliers  of  computers  built  to  MIL-STD- 
1750  including  four  from  England  (Enclosure  1). 

Significant  cost  avoidances  have  been  demonstrated  on  the 
F-lll  upgrade  and  the  F-SGII  aircraft  as  a  direct  result 
of  this  available  competition. 

The  Army  is  using  M1L-STD-1750  equipment  in  at  least  two 
systems. 

There  is  a  formal  agreement  for  the  Air  Force  to  use  the 
Army's  MIL-STD-1862  ISA  when  available. 


As  we  read  the  current  report,  there  are  two  salient  differences 
in  viewpoint  between  our  position,  which  has  evolved  over  the  past 
six  years,  and  that  of  the  GAO  and  a  small  segment  of  the  computer 
industry: 


o  Defense  must  be  concerned  with  the  acquisition  of  adequate 
equipment  (minimum- essential  with  provision  foT  realistic 
growth)  and  the  life-cycle  support  of  that  equipment. 

Post -acquisition  costs  normally  run  from  three  to  ten  times 
original  acquisition  costs  for  hardware.  Software  costs 
for  a  system  over  its  life  also  range  to  several  tines 
the  hardware  costs  and  the  proportion  dedicated  to  soft¬ 
ware  is  growing. 

o  We  do  not  agree  with  the  GAO  assessment  of  "commercial" 
versus  "military”  technology  in  this  field. 

More  specific  discussions  of  the  report  and  responses  to  the 
specific  questions  voiced  in  its  Enclosure  I  are  given  in 
Enclosures  2  and  3,  respectively. 


The  Defense  Science  Board  Task  Force  on  Embedded  Computer  Resources 
Acquisition  and  Management  has  reported  out  to  the  full  Defense 
Science  Board.  Their  findings  ana  recommendations  with  respect 
to  proposed  Instruction  5000. 5X  are  summarized  in  Enclosure  4. 

The  Board,  in  accepting  the  Task  Force  results,  recommends  that 
we  proceed  with  5000. SX  and  further  recommends  that  we  work  with 
industry  to  seek  a  means  to  add  "commercial"  Instruction  Set 
Architectures  to  its  list.  We  will  aggressively  pursue  that 
added  recommendation. 


ENCLOSURE  I 


ENCLOSURE  I 
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The  Task  Force's  final  report  is  in  preparation  and  should  be 
available  by  aid-April.  I  will  have  a  copy  provided  to  you  as 
soon  as  possible. 

GAO's  second  recommendation  to  limit  our  standardisation  efforts 
to  programming  language  alone  is  not  practical  at  this  time.  We 
do  not  agree  that  significant  architectural  innovations  are  nearby. 
We  do  not  believe  that  a  technological  filibuster  while  awaiting 
breakthrough  and  production  availability  is  sound.  We  will  follow 
closely  the  results  of  industry- sponsored  research  as  well  as  that 
sponsored  by  DoD  and  make  every  honest  effort  to  select  the  most 
appropriate  equipment  for  our  needs. 

We  have  explicitly  designated  the  Under  Secretary  of  Defense, 
Research  and  Engineering,  as  the  Senior  Official  to  be  responsible 
for  all  computer  acquisitions  covered  by  10  U.S.C.  231S. 

Thank  you,  Mr.  Bowsher,  for  your  continued  interest.  I  trust  that 
we  may  work  closely  together  to  resolve  any  remaining  concerns. 


Enclosures 
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ENCLOSURE  I 


EVALUATION  OP  AGENCY  COMMENTS 
POD  INSTRUCTION  5000. 5X.  STANDARDIZATION 
SET  ARCHITECTURES  FOR  EMBEDDED  COMPUTERS 

POD  LETTER 


I  aust  respectfully  disagree  with  your  conclusions  that: 

o  "...this  (proposed)  policy  would  lock  DoD  into  the  use 
of  inferior  technology." 


o  "...DoD  would  not  he  able  to  take  advantage  of  private 
industry's  technical  innovations." 


o  "...it  would  severely  restrict  competition  to  those 
companies  willing  to  help  DoD  implement  obsolete 
technology.” 


Our  experience  to  date  has  demonstrated  the  opposite  effect. 
Hence,  we  believe  the  proposed  policy  is  an  established  success, 
even  before  formal  issuance. 


OUR  EVALUATION 

The  majority  of  programs  within  DOD  that  usa  embedded  com¬ 
puters  do  not  use  computers  defined  by  this  proposed  standard. 
The  experience  in  the  Navy  where  standard  computers  are  used 
cannot,  by  any  stretch  of  the  imagination,  be  considered  "an 
established  success." 


DOD  LETTER 

Th«  GAO  was  invited  to  observe  meetings  of  the  recent  Defense 
2J.J2  JS.rd  review  of  this  subject.  However,  the  two  groups 
reached  quite  different  conclusions.  Further,  the  conclusions 

and  recommendations  of  the  GfcO  report  do  {£*  *?“£*  ifoSlnse's 
*arit«r  r« views  of  this  same  issue  (  The  Department  of  Defense  s 

Standardization  Program  for  co*pujmr»- -A  More  Un  e 

Effort  is  Needed,"  June  IS,  1980,  ICD-80-69). 

OUR  EVALUATION 

The  report  (LCD-80-49)  mentioned  is  almost  2  years  old.  * 
Some  of  the  conclusions  reached  at  this  earlier  date  could  indeed 
be  different  and  would  again  demonstrate  the  rapid  technology 
advSnce  within  the  computer  industry. 
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POD  LETTER 


One  recommendation  from  that  earlier  report,  and  echoed  in  the 
current  letter  report,  is  that  Ada  should  be  implemented  as  DoO's 
standard  programming  language.  We  agree.  We  followed  GAO's 
recommendation  to  establish  a  tri-Service  program  office  for  that 
purpose. 


OUR  EVALUATION 


We  are  pleased  that  DOD  is  moving  forward  with  Ada.  It  ap¬ 
pears,  however,  that  the  computer  industry  may  be  moving  faster 
than  DOD,  because  DOD  is  not  uniformly  and  readily  accepting  its 
own  success  with  Ada. 

DOD  LETTER 


Experience  with  the  principles  of  S000.SX,  although  it  has  not 
been  formally  issued,  are: 

-  There  were  12  significant  bidders  for  the  Army  Military 
Computer  Family  (MCF)  Program  based  upon  the  Government 
MIL*- STD-1862  Instruction  Set  Architecture  (ISA).  Earlier, 
when  the  program  was  based  upon  a  commercial  ISA,  there 
were  only  two. 


OUR  EVALUATION 

The  previous  program  which  resulted  in  only  two  bidders  had 
more  problems  besides  the  data  rights  to  a  commercial  architec¬ 
ture.  Many  bidders  did  not  bid  because  the  requirement  was  for 
standard  interchangeable  boards  with  competition  at  the  board 
level.  The  Army  has  since  revised  the  MCF  program  and  deleted 
this  ill-conceived  requirement.  It  is  also  important  to  note  that 
the  present  MCF  program  which  was  bid  on  a  cost  plus  basis  is 
experiencing  cost  overruns.  The  only  participant,  which  cur¬ 
rently  markets  commercial  computers,  has  been  terminated  by  the 
Army. 


ENCLOSURE  I 


ENCLOSURE  I 


POD  LETTER 


-  There  are  over  20  suppliers  o£  computers  built  to  MIL-STD- 
17S0  including  four  from  England  (Enclosure  1). 

OUR  EVALUATION 

There .appears  to  be  some  inaccuracies  in  this  statement  and 
enclosure  1.  We  have  determined  that  at  least  two  of  the  sup¬ 
pliers  named  by  DOD  do  not  market  1750A  computers. 

POP  LETTER  . 


Significant  cost  avoidances  have  been  demonstrated  on  the 
F-lll  upgrade  and  the  F-5GII  aircraft  as  a  direct  result 
of  this  available  competition. 


OUR  EVALUATION 

The  cost  comparison  to  claim  savings  was  between  the  1750A 
computer  and  older  computer  models  which  were  replaced  and  which 
had  much  higher  costs.  No  comparison  was  made  between  1750A  and 
currently  available  proprietary  products  with  greater  functionality 
and  lower  total  life-cycle  costs. 

POP  LETTER 


-  The  Army  is  using  MIL-STD-1750  equipment  in  at  least  two 
systems. 


OUR  EVALUATION 

Two  systems  are  a  very  small  number  in  view  of  the  total 
population  of  the  Army's  systems. 

OOP  LETTER 


-  There  is  a  formal  agreement  for  the  Air  Force  to  use  the 
Army's  MIl-STD-1862  ISA  when  available. 


OUR  EVALUATION 

The  Air  Force  can  choose  to  use  the  Army  architecture, 
however,  they  are  not  required  to  do  so. 
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ENCLOSURE  I 


POD  LETTER 


As  we  read  the  current  report,  there  are  two  salient  differences 
in  viewpoint  between  our  position,  which  has  evolved  over  the  past 
six  years,  and  that  of  the  GAO  and  a  snail  segment  of  the  computer 
industry: 


OUR  EVALUATION 


DOD  suggests  that  only  a  small  segment  of  the  Industry  agrees 
with  us.  However,  the  American  Electronics  Association  with  ap¬ 
proximately  1,900  members,  many  of  which  are  major  computer  sup¬ 
pliers,  and  Computer  and  Business  Equipment  Manufacturers  Asso¬ 
ciation,  which  represents  members  whose  total  industry  related 
revenues  are  in  excess  of  $50  billion  and  employ  about  750,000 
people,  have  both  publicly  expressed  concern  regarding  approval 
and  implementation  of  DOD  Instruction  50OO.5X. 

POP  LETTER 


o  Defense  must  be  concerned  with  the  acquisition  of  adequate 
equipment  (minimum- essential  with  provision  for  realistic 
growth)  and  the  life-cycle  support  of  that  equipment. 
Post-acquisition  costs  normally  run  from  three  to  ten  times 
original  acquisition  costs  for  hardware.  Software  costs 
for  a  system  over  its  life  also  range  to  several  times 
the  hardware  costs  and  the  proportion  dedicated  to  soft¬ 
ware  is  growing. 

OUR  EVALUATION 

OOP  continues  to  focus  on  hardware  acquisition  and  post  ac¬ 
quisition  costs.  Their  estimate  of  software  costs  are  grossly  low. 
A  recent  Blectronlcs  Industry  Association  report  concluded  that 
software  costs  represent  about  $5  percent  of  the  cost  of  an  em¬ 
bedded  computer  system  and  will  grow  to  about  85  percent  of  the 
system  cost  by  1990  which  is  about  the  time  some  of  the  proposed 
architectures  will  be  implemented. 
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ENCLOSURE  I 


ENCLOSURE  I 


POD  LETTER 


o  We  do  not  agree  with  the  GAO  assessment  of  "commercial" 
versus  "military"  technology  in  this  field. 

OUR  EVALUATION 


DOD  appears  to  b«  in  disagreement  with  itsalf.  A  racant  quo¬ 
tation  by  Dr.  DeLauer,  Under  Secretary  of  Defense  for  Research  and 
Engineering,  states 

«*  e  *  the  military  community  must  take  advantage  of 
the  incredible  strides  that  have  been  made  in  the 
commercial  sector  in  data  and  signal  processing .  we 
must  tap  this  source  to  secure  equipment  that  is  more 
timely  and  effective  and  less  costly.*  ( Emphasis  added ) 

The  Secretary  of  Defense  also  stressed  this  approach  in  his 
fiscal  year  1983  annual  report  to  the  Congress.  He  stated 

■  *  *  •  greater  effort  will  be  placed  on  avoiding  de¬ 
velopment  costs  by  increased  utilization  of  commercial 
market  place  supplies  and  equipments  through  accelerated 
use  of  industry  standards  and  development  of  simplified 
specifications  and  commercial  item  descriptions  for  de¬ 
fense  procurement  of  competitive  off-the-shelf  items.* 

DOD  LETTER 


The  Defense  Science  Board  Task  Force  on  Embedded  Computer  Resources 
Acquisition  and  Management  has  reported  out  to  the  full  Defense 
Science  Board.  Their  findings  and  recommendations  with  respect 
to  proposed  Instruction  S000.SX  are  summarized  in  Enclosure  4. 

The  Board,  in  accepting  the  Task  Force  results,  recommends  that 
we  proceed  with  S000.SX  and  further  recommends  that  we  work  with 
industry  to  seek  a  means  to  add  "commercial"  Instruction  Set 
Architectures  to  its  list.  We  will  aggressively  pursue  that 
added  recommendation. 

The  Task  Force's  final  report  is  in  preparation* and  should  be 
available  by  mid-April.  I  will  have  a  copy  provided  to  you  as 
soon  as  possible. 


OUR  EVALUATION 


We  have  not  seen  the  Defense  Science  Board  Task  Force  report, 
at  this  time.  When  the  final  report  is  available,  it  will  be  eval 
uated  as  a  part  of  our  current  review  of  DOD's  efforts  to  standard' 
ise  military  computers. 


ENCLOSURE  I 


ENCLOSURE  I 


POD  LETTER 


GAO's  second  recommendation  to  limit  our  standardization  efforts 
to  programming  language  alone  is  not  practical  at  this  time.  We 
do  not  a^ree  that  significant  architectural  innovations  are  nearby. 
We  do  not  believe  that  a  technological  filibuster  while  awaiting 
breakthrough  and  production  availability  is  sound.  We  will  follow 
closely  the  results  of  industry- sponsored  research  as  well  as  that 
sponsored  by  DoD  and  make  every  honest  effort  to  select  the  most 
appropriate  equipment  for  our  needs. 


OUR  EVALUATION 

We  do  not  purport  that  standardization  be  limited  to  pro¬ 
gramming  languages;  however,  we  believe  that  standardization 
should  be  occurring  at  high  level  interconnect  and  software  in¬ 
terfaces.  We  have  determined  that  significant  architectural  in¬ 
novations  have  been  developed  in  the  commercial  computer  environ¬ 
ment  and  believe  that  these  innovations  will  continue. 


9 


ENCLOSURE  I 


•  I 


DISCUSSION  OF  OUR  LETTER  REPORT 
)  INSTRUCTION  5000. 5X,  STANDARD  INSTRUCTION  SET 
TECTURES  FOR  EMBEDDED  COMPUTERS" " ( MASAD-82-16T 


INT 


Letter  report  (page  1) 

c  advances  have  been  made  in  software  technology, 
cognized  that  a  lack  of  a  standard  programming  language 
1  contributor  to  the  high  cost  of  developing  and  maintain- 
.re  for  military  applications.  DoD  is  to  be  commended  for 
tive  to  fill  that  void  by  developing  a  common  high  order 
ig  language  called  Ada.  Ada  very  specifically  aims  to 
[apt  a  very  wide  variety  of  DoD  applications  to  most  present 
e)  computer  architectures.  Ada  can  potentially  encompass 
ularly  useful  aspects  of  future  architectural  advances  and 
’  gains  available  to  users,  without  their  having  to  learn 
about  how  the  gains  were  realized.  In  other  words, 
pursuit  of  a  standard  high  order  language,  such  as  Ada, 
viate  the  software  proliferation  problem  and  at  the  same 
t  the  Government  to  fully  capitalize  on  architectural 


Ada  is  indeed  coming  and,  when  implemented,  will  have  major 
the  software  process.  There  have  not  been  dramatic  advances 
e  technology  and  the  inefficiencies  of  continuing  the  pro¬ 
of  the  past  will  live  on  for  decades  in  specific  systems, 
vements  have  been  made  in  commercial  and  military  software 
t  and  support  processes  have  been  both  slow  and  inconsistent. 

ATION 

racy  to  DOD  statements,  dramatic  software  technological 
have  been  made  in  the  past  few  years.  Structured  pro-* 
implementation  languages  (Pascal  and  Ada)  are  now  being 
dustry  accepted  software  tools  for  improving  programmer 
ity,  greater  availability  of  systems  utilities  and  li~ 
better  human  interfaces,  file  structures,  and  systems 
se  more  widespread.  Most  all  of  the  costs  of  these  dra- 
Blopments  have  been  borne  by  the  commercial  computer 
All  of  these  costs  will  have  to  be  duplicated  by  DOD 
unique  architectures.  However,  we  have  serious  doubts 
sould  do  this  in  an  effective  and  justifiable  manner  be- 
bhe  substantial  costs  involved  in  duplicating  the  private 
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POD  COMMENT 

2.  Ref:  Letter  report  (page  2) 

"--Likewise  there  have  been  many  advances  in  computer  technology. 

These  advances  are  the  result  of  demands  made  by  the  civilian  sector 
for  more  reliable  and  rugged  computers.  And  indeed,  the  civilian 
sector  is  starting  to  impose  much  stiffer  reliability  requirements 
on  integrated  circuits.  These  advances  will  be  realized  probably  at 
little  or  no  cost  penalty  because  all  integrated  circuits  will  be  made 
to  the  same  high  standards.  There  are  computer  companies  already 
marketing  highly  reliable  computers  through  the  use  of  innovative 
architectures.  These  modern  computers  have  substantially  fewer  parts 
and  in  many  cases  are  a  computer  on  a  single  board  thereby  reducing 
the  need  for  extensive  logistics  support." 

Response:  By  standardizing  at  the  interface  between  software  and  the 
Hardware  upon  which  it  runs,  DoD  can  gain  access  to  the  best  commercial 
processes  without  being  locked  to  single  suppliers.  Although  the 
commercial  market  does  demand  better  reliability,  their  needs  do  not 
match  those  of  the  military  environment.  The  "innovative"  architectures 
used  in  the  commercial  world  are  at  a  system  level  and  have  little  or 
nothing  to  do  with  ISAs.  The  computer-on- a-board  is,  in  fact,  an 
argument  favoring  ISA  standardization  because  any  computer  instantia¬ 
tion  must  have  a  native  ISA  and  for  the  logistics  argument  to  hold, 
standard  hardware  is  implied  and  hence  a  standard  ISA  is  demanded, 
de  facto.  Working  from  hardware  up  implies  restricted  competition, 
by  any  practical  measure;  starting  with  the  ISA  first  allows  open  and 
equitable  competition  so  as  long  as  the  actual  selection  does  not 
itself  force  restriction;  i.e.,  so  long  as  the  Government  has  unlimited 
rights  in  that  ISA. 

OUR  EVALUATION 

DOD  maintains  that  a  standard  architecture  will  provide 
a  means  of  utilizing  "the  best  commercial  processes  without 
being  locked  to  single  suppliers."  We  disagree  with  this 
position. 

Our  position  is  more  accurately  stated  by  Dr.  DeLauer, 
as  follows: 

"*  *  *  no  longer  are  we  buying  individual  computer 
hardware.  We're  buying  complex  data  processing  sys¬ 
tems  in  which  the  processor  hardware  is  only  a  small 
part,  it  makes  as  little  sense  to  control  the  proces- 
sor  in  an  information  management  system  as  to  control 
individual  parts  of  a  communication  system — now  the 
ratio  is  almost  reversed  with  software  the  predominate 
We  ought  to  be  concerned  with  the  software~not 
hung  up  on  the  hardware  issue."  (Emphasis  added) 
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ENCLOSURE  I 


POD  COMMENT 

3.  Ref:  Letter  report  (page  2) 

"--Improved  competition  using  militarized  versions  of  commercial 
computers  will  open  up  competition  to  many  firms  that  would  not 
bid  on  specifications  with  DoD-owned  architectures.  The  resulting 
unit  prices  will  be  less  because  DoD  will  not  pay  for  duplicating 
hardware  development  and  control  and  utility  software  development 
as  it  proposed  to  do  under  Instruction  5000. SX.  Lower  hardware 
unit  costs  and  high  hardware  quality  are  in  fact  available  in  the 
commercial  market  because  of  the  technology  and  broader  market 
base." 

Response:  It  has  been  demonstrated  that  basing  competition  on  a 
commercial  computer  restricts  competition.  Far  more  companies 
have  bid  on  MIL-STD-1750  and  MIL-STD-1862  based  procurements  than 
have  ever  been  experienced  with  other  approaches.  "Commercial 
computers"  is  at  best  a  shibboleth  for  restricted  competition. 
Attachment  1  compares  performance  and  cost  of  a  representative 
"equivalent"  commercial  product  to  the  Navy  AN/UYK-43  and  44.  The 
facts  are  contrary  to  the  assertion.  ! 


"--DoD  ownership  of  architectures  would  seriously  inhibit  competition 
by  a  significant  portion  of  the  computer  industry,  and  therefore  DoD 
would  not  have  the  flexibility  to  capitalize  on  advances  in  computer 
architectural  technology  in  a  timely  fashion.  The  ultimate  impact 
would  result  in  DoD  very  likely  running  the  risk  of  getting  locked 
into  obsolete  architectures." 

Response :  Direct  experience  has  demonstrated  the  converse  of  this 
assertion.  Those  who  have  not  competed  have  made  a  conscious  choice 
not  to  do  so.  Far  more  qualified  bidders  have  competed  when  ISAs 
for  which  the  Government  has  unlimited  rights  were  used  as  the  basis 
for  the  procurement. 

OUR  EVALUATION 

DOD  asserts  "*  *  *  that  basing  competition  on  a  commercial 
computer  restricts  competition."  We  agree  with  this  position 
because  competition  should  be  based  on  the  military  or  users' 
functional  specifications.  Basing  competition  on  any  computer — 
commercial  or  military— rather  than  functional  specifications 
is  inherently  restrictive.  For  example,  both  the  Army's  HCF  pro¬ 
gram  and  the  Navy  AN/UYK-43  and  44  programs  have  put  DOD  into  the 
computer  manufacturing  business  where  DOD  is  specifying  the  archi¬ 
tecture  for  military  computers.  This  specification  restricts  com¬ 
petition  and  can  place  unnecessary  demands  upon  the  responding  com¬ 
panies,  because  the  computer  architecture  is  arbitrarily  specified. 
In  a  recent  case,  the  Army  terminated  a  major  international  supplier 
of  commercial  and  military  computers  from  the  MCF  program.  This 
was  as  a  result  of  projected  cost  overruns  apparently  incurred  in 
trying  to  comply  with  a  military  architecture' specification. 
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ENCLOSURE  I 


POD  COMMENT 

4.  Refs  Letter  report  (page  2) 


-DoD  would  not  be  able  to  efficiently  utilize  the  new  DoD  programing 
language  Ada  and  will  not  be  able  to  fully  capitalize  on  the  anticipated 
software  cost  savings  Ada  was  designed  to  yield." 

Response :  The  ability  to  utilize  Ada  is  not  dependent  upon  the  ISA, 
per  se.  The  question  is  compiler  and  support  software  (environment) 
availability.  It  is  more  efficient  and  economical  if  the  scarce 
national  resources  (personnel)  are  engaged  in  producing  the  best 
possible  environments  for  a  few  ISAs  than  to  partially  optimize  a 
large  number  of  them.  NEBULA  is  an  efficient  Ada  target,  despite 
claims  of  certain  companies  to  the  contrary. 

The  advantages  of  Ada  will  be  muted  if  sound  management  of  the  environ¬ 
ment  -to  -hardware  interface  (ISA)  is  not  achieved. 

OUR  EVALUATION 

We  generally  agree  with  DOD  that  ”*  *  *  the  ability  to 
utilize  Ada  ia  not  dependent  upon  the  ISA  or  architecture  *  *  *.” 

DOD' a  statement  that  "*  *  *  the  question  ia  compiler  and 
support  software  (environment)  availability”  is  partially  cor¬ 
rect.  However,  our  position  is  that  compiler  and  support  soft¬ 
ware  (environment)  are  furnished  by  the  computer  manufacturer 
or  a  software  company.  We  disagree  with  DOD  that  it  is  neces¬ 
sary  or  economically  justified  for  DOD  to  duplicate  industry 
and  develop  and  maintain  compilers  and  support  software  for  DOD 
specified  architectures. 

Further,  we  do  not  support  the  concept  of  DOD  specified 
architectures  because  this  unnecejsarily  locks  DOD  into  a 
given  point  in  time  and  precludes  using  technological  advances. 

DOD  COMMENT 

5.  Reft  Letter  report  (pages  2  and  3) 

"--The  three  Services  have  initiated  efforts  commensurate  with 
Instruction  S000.5X;  for  example,  the  Army's  Military  Computer 
Family,  the  Navy's  AN/UYK-43  and  44,  and  the  Air  Force's  1750 
programs.  In  a  previous  report  entitled  "The  Department  of  Defense's 
Standardization  Program  for  Military  Computers- -a  More  Unified  Effort 
is  Needed"  (LCD-80-69,  June  18,  1980),  we  were  critical  of  both  the 
Army  and  Navy  efforts.  We  made  the  following  statements  in  that 
report  and  believe  they  are  even  more  valid  today: 

»***some  computer  manufacturers  are  already  designing  computers 
with  modern  architectures  that  will  have  Ada  compilers  available. 
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cjlI'l/JSUFs-  I 


These  or  other  manufacturers  will  probably  offer  follrw-on 
computers  that  will  directly  carry  out  Ada  instr- .ctic-s  and 
stantially  improve  performance  reliability.  Bee. » use  these 
provide  better  support  options,  such  as  building  more  redum.a-.'; 
into  systems,  they  should  compel  the  Department  -0  further  e\a»»‘ 
the  level  of  standardization  to  be  achieved  bef'.re  allowing  j,jed. 

and  Navy  to  commit  themselves  ***  for  the  long  —  «rm.  tEmphasi' 

"We  view  the  need  for  architecture  standard .zation  as  a  *l‘‘^rummicg 
in  part,  of  the  availability  of  Ada  as  the  stanc-ard  computer  "  table 
language.  Because  Ada  is  being  developed  to  be  a  machine-tran  d 

language  with  a  relatively  low  life  cycle  mainc.-rnance  cost,  ***. 

for  standard  architectures  nay  be  diminished  whse'-  it  i*  avail* 

(Emphasis  added.)" 

Response:  Some  computer  manufacturers  are  indexed  producing 
architectures  for  which  Ada  will  be  available.  The  direct:e\«^  tioH. 
machine  is  not  available  and  practical  feasibil-- -y  is  Y9t  in  ** 

Had  GAO  completed  the  quotation  it  would  have  included: 

"...In  the  long  term,  Ada  could  become  the  standard 
When  computers  that  can  directly  execute  the  l*rr  zuflf  215.  2*1*1  h.teded 
Ho^ver^  in  theTTiorFTeri7»tSndar3compunrr  arr  chlteclures  ai  *  1 
to  reduce  life-cycle  costs.  We  believe  that  thc-se  architecture 
should  be  common  across  Service  lines,  compatii— *  with  Ada  an%«  ,  t0 

minimum  number  required  to  meet  common  functional  requirement^*  ure 

retain  the  older  languages,  such  as  CMS-2  and  "WIAL,  until  cotts 

phased  out.  These  measures  are  necessary  to  eur-imix*  lira  c>*. 
and  to  facilitate  the  transition  to  Ada." 

Truncating  the  quotation  completely  changed  tk*  context  and  to 

misunderstanding . 

OUR  EVALUATION 

Computer  manufacturere  ere  marketing  computer*  with 
vative  architectures  on  which  Ada  is  bels^  implemented.  »  ocd#r 
not  believe  that  a  direct  execution  machine  i*  n*c**ff! Connect  be 
that  high  level  standards  for  machine  in-dmrpendent  lnt#^°.Cy  for 
accomplished,  if  000  would  use  the  same  sr-esources  nee**"  J  and 
the  apparent  management  commitment  to  hardware  •*c;lj;?:;connect 
*PPly  them  to  supporting  the  voluntary  self t-ware  and  int*» 
standards  process,  they  would  be  further  mtnead. 
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POD  COMMENT 
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OUR  EVALUATION 


We  believe  that  this  comparison  of  one  manufacturer's  mili¬ 
tarized  computer,  currently  available,  with  the  anticipated  Navy 
computers  is  not  a  true  reflection  on  an  evaluation  of  commercial 
architectures.  The  Navy's  computer  will  require  continued  invest¬ 
ment  in  research  and  development  funds  by  DOD;  whereas,  these  costs 
for  militarized  commercial  computers  are  supported  by  commercial 
sales,  in  addition,  the  Navy  computers  may  or  may  not  become 
available  as  specified  and  in  the  projected  time  frame.  Also 
militarized  commercial  computers  capabilities  in  the  future  will 
be  substantially  improved. 
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POD  Responses  to  Specific  Questions 
Regarding  Proposed  bop  instruction  5000. SX 

POP  COMMENT 


What  effect  would  Instruction  S000.5X  have  on  the  use  of 
competition  in  the  Department  of  Defense? 

Answer:  The  objective  of  proposed  DoD  Instruction  5000. SX  is 
to  control  and  maintain  the  interface  between  MIL -SPEC  (see 
attached  definitions)  computer  hardware  and  the  software  which 
runs  on  it.  This  interface  is  termed  the  "instruction  set 
architecture"  or  ISA  of  the  computer  (a  more  rigorous  definition 
is  given  in  Enclosure  5) .  An  ISA  may  be  implemented  in  hardware 
using  whatever  design  and  components,  processes,  etc.,  which  the 
producer  chooses.  DoDI  5000. SX  lists  a  small  set  of  approved 
ISAs,  in  all  of  which  the  Government  has  unlimited  rights  (i.e., 
can  freely  use) . 

When  recent  procurements  have  been  based  upon  these  ISAs,  theTe 
was  a  demonstrated  increase  in  the  numbers  of  qualified  bidders 
participating.  In  the  recent  competition  for  the  Army's  Military 
Computer  Family  (MCF)  based  upon  MIL-STD-1862  or  the  NEBULA  ISA, 
there  were  12  bidders- -more  than  had  been  experienced  on  any 
similar  procurement  not  based  on  ISAs  in  which  the  Government  had 
unlimited  rights. 

The  Air  Force  has  had  similar,  but  more  extensive,  experience  with 
their  procurements  based  upon  MIL- STD- 17 50,  another  ISA  on  the 
proposed  5000. SX  list  and  in  which  the  Government  has  unlimited 
rights.  There  are  currently  23  suppliers  of  equipment  built  to 
the'  MIL-STD-17S0  ISA,  fouT  of  which  are  from  England.  Enclosure  1 
lists  these  companies.  Further,  when  MU<-STD-1750  was  used  as 
the  basis  for  the  computers  for  the  F-lll  upgrade  program,  the 
resulting  competition  allowed  the  opportunity  foT  insertion  of  new 
technology  and  reduced  the  price  of  the  computers  by  almost  SOI. 
Prior  to  invoking  MIL-STD-1750,  procurements  were  sole  source  in 
many  instances,  and  otherwise  restricted  competition  at  best. 

The  net  of  it  is  that  application  of  the  principles  of  DoDI  5000. 5X 
has  invariably  enhanced  competition  and  reduced  cost--this  is 
demonstrated  experience  and  not  speculation  on  what  the  effects 
might  be. 


What  effect  would  Instruction  5000. SX  have  on  the  current  computer 
industry? 

Answer:  As  noted  above,  the  instruction  encourages  and  opens  up 
competition.  On  any  given  procurement,  a  broader  section  of  the 
industry  can  compete  on  a  more  equitable  basis  than  was  possible 
under  earlier  acquisition  strategies.  Of  course,  any  given  computer 
manufacturer  may  choose  not  to  participate  because  of  a  corporate 
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philosophy  which  permits  it  only  to  market  in  an  environment 
which  minimizes  competition,  or  if  it  perceived  that  the 
competitive  environment  could  negatively  effect  its  eventual 
market  share.  How  this  will  balance  out  over  time  is  yet  to 
be  determined.  Clearly,  the  proposed  instruction  will  reduce  the 
present  extent  of  sole* source  acquisitions  of  proprietary  products, 
and  that  may  be  interpreted  by  some  of  the  industry  as  negative; 
from  the  Government's  perspective  and  that  of  the  broader  industry 
sector,  it  must  be  viewed  as  positive. 


OOR  EVALUATION 

We  do  not  agree  that  Instruction  5000. Sx  encourages  and  opens 
up  effective  competition.  On  any  given  procurement,  a  section  of 
the  electronics  industry,  which  is  primarily  not  the  commercial 
computer  industry,  might  compete  on  a  specific  procurement  to  meet 
military  computer  needs.  This  does  not  necessarily  mean  the  total 
systems  cost  will  be  competitive  with  that  provided  by  companies 
manufacturing  either  commercial  equipment  or  military  specifica¬ 
tions  equivalence  of  commercial  equipment.  Once  again  we  are  sug¬ 
gesting  that  by  using  militarised  versions  of  commercial  architec¬ 
tures,  OOO  can  still  gain  effective  competition  and  reduce  its 
costs  significantly. 

000' s  comment  regarding  given  computer  manufacturers  partici¬ 
pating  might  be  questioned.  000  should  look  at  the  number  of  com¬ 
mercial  computer  manufacturers  that  are  presently  building  the  MCF 
design.  It  should  be  noted  that  at  this  point  in  time  there  are 
none.  It  is  not  clear  that  the  Army's  plan  to  select  a  single 
vendor  under  the  MCF  program,  for  5  years  for  use  on  all  Army  pro¬ 
grams  is  any  different  than  some  of  000’ s  past  actions  regarding 
sole-sourcing  equipment. 

000  should  also  look  at  three  of  the  five  standard  architec¬ 
tures  included  in  Instruction  5000. 5X,  the  Navy's  AN/0YK-7, 
AN/UYK-20,  and  AN/AYK-1 4 .  Each  of  these  only  has  one  vendor  in 
production.  The  AN/UYK-43  and  AN/UYK-44  development  program,  re¬ 
placement  for  the  AN/UYK-7  and  AN/UYK-20,  only  had  two  vendors 
submit  bids.  We  do  not  believe  that  this  experience  to  date  can 
be  construed  as  encouraging  and  opening  up  competition  nor  can  this 
be  construed  as  "an  established  success.'' 


18 


POD  COMMENT 


Would  Instruction  5000. SX  lock  DoD  into  obsolete  technology? 

Answer:  Recall  that  the  ISA  is  the  interface  between  software  and 
hardware.  Standardization  at  that  interface  has  been  demonstrated 
to  allow  and  even  encourage  the  injection  of  new  technology. 

Although  there  are  some  performance  parameters  to  be  specified  at 
that  interface,  both  within  and  in  addition  to  the  ISA,  there  is 
essentially  transparency  at  the  ISA  to  the  implementing  technology. 
The  expert  opinion,  upheld  by  experience,  is  that  breaking  the 
sole-source  procurement  syndrome  or  its  handmaiden,  weak  competition, 
will  accelerate  the  injection  of  technology- -quite  contrary  to 
locking  the  Department  in  to  obsolescence.  That  lock-in  not  only 
to  technology  but  also  to  supplier,  is  precisely  the  lesson  to  be 
learned  from  earlier  approaches. 


OPR  EVALUATION 


There  are  numerous  commercial  computer  suppliers  which  have 
been  technologically  innovative.  These  modern  computer  architec¬ 
tures  will  have  a  difficult  time  competing  for  weapon  system  devel¬ 
opment  programs  because  of  DOD's  arbitrary  specifications  for  com¬ 
puter  architecture.  If  DOD  was  to  put  its  efforts  at  the  high 
interconnect  standards  as  previously  discussed  and  move 
further  away  from  the  internal  hardware  design  as  recommended  by 
Or.  DeLauer  (as  previously  quoted),  it  i-ould  have  a  much  better 
chance  of  accomplishing  its  goals  for  lower  life-cycle  costs  of 
military  computer  systems. 

DOD  COMMENT 


Are  commercial  off-the-shelf  computers  currently  available  that 
could  satisfy  DoD’s  major  needs  for  embedded  computers? 

Answer:  In  some  cases  the  answer  must  be  "yes."  And,  in  those 
cases  where  the  logistics  implications  are  tractable,  where  there 
is  no  need  for  militarization,  and  where  there  can  be  a  fair  and 
open  competition,  then  some  preference  should  be  given  to  the 
off-the-shelf  approach.  Generally,  "off-the-shelf"  means  a  common, 
commercial  product  intended  for  the  civilian  marketplace  and  one 
designed  and  produced  in  a  proprietary  way.  The  need  for  any 

or  ®l«ctrical  characteristics  of  the  machine 
break  the  off-the-shelf"  model.  In  some  instances,  several 
manufacturers  could  start  with  their  proprietary  "soft"  product  and 
through  redesign  and  modification  provide  acceptable  militarized 

w2?ld  not  a*?t  th®  ®*»«ntial  "off-the-shelf"  test. 
Further,  it  is  often  true  that  existing  software  must,  for  reasons 

schedule  or  risk,  be  accommodated.  Except  in  rare  cases, 
tne  implication  is  sole- source  pi'ucu«em«ut  end  the  well-known 

n*?®Jiv®  aspects  are  acceptable  in  the 
ff-the-shelf  is  a  viable  acquisition- strategy  alternative 
and  should  be  so  considered.  In  no  way  can  it  be  considered  the 
predominant  method. 


OUR  EVALUATION 


Off-the-shelf  does  not  necessarily  mean  a  commercial  product 
for  the  civilian  marketplace.  There  are  off-the-shelf  military 
products  as  well'  offered  by  multiple  vendors.  These  are  military 
versions  of  commercial  architectures  which  have  been  developed  in 
the  highly  competitive  marketplace  as  evidence  by— Hughes  produc¬ 
tion  of  Perkin  Elmer  equipment ,  Rolm  production  of  Data  General 
equipment,  and  Norden  production  of  Digital  Equipment  Corporation 
equipment.  In  addition,  the  Air  Force  has  recently  concluded  a 
contract  with  Intel  to  provide  a  license  to  DOD  systems  suppliers 
to  produce  the  highly  successful  Intel  8036  architecture  in 
militarized  versions.  This  license,  which  restricts  the  use  of 
the  Intel  architecture  to  militarized  designs,  was  acquired  from 
Intel  for  $1.00. 

DOD  COMMENT 


Should  standardization  occur  at  the  instruction  set  architecture  (ISA) 
level  or  at  the  higher  level  languages,  such  as  Ada? 

Answer:  Standardization  is  required  at  both  the  high  order  language 
(H6L)  and  instruction  set  architecture  levels.  HOL  standardization 
improves  the  efficiency  of  applications  code  and  the  transportability. 
ISA  standardization  is  necessary  to  allow  reuse  of  systems  and 
support  software  from  system- to-system.  Together  they  can  provide 
significant  productivity  and  economics.  Either  alone  is,  at  best, 
a  partial  solution  to  these  problems.  Until  the  non-stop,  never- fail 
true  High  Level  Language  (HLL)  machine  is  practical  and  available, 

ISA  standardization  is  the  only  way  to  enable  application  and  system 
software  reuse.  It  should  also  accelerate  the  availability  of  Ada, 
per  se,  and,  hence,  perhaps  hasten  the  reality  of  the  HLL  machine. 


OUR  EVALUATION 

We  agree  with  DOD  that  ”*  *  *  HOL  (high-order  language)  im¬ 
proves  the  efficiency  of  applications  code  and  the  transporta¬ 
bility." 

The  following  DOD  statement  on  architecture  standardiza¬ 
tion  is  incorrect  and  misleading.  We  quote  DOD: 

"ISA  standardization  is  necessary  to  allow  reuse 
of  systems  and  support  software  from  system-to- 
system." 

First,  commercial  software  companies  provide  certain  support 
software  for  two  or  more  different  types  of  commercial  computers. 
Second,  there  is  no  commercial  architecture  standardization  neces¬ 
sary  to  use  selected  commercial  support  software  from  software 
companies  on  two  or  more  different  brands  of  computers. 
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